Recognizing Predictive Substructures with Subgraph Information Bottleneck
نویسندگان
چکیده
The emergence of Graph Convolutional Network (GCN) has greatly boosted the progress graph learning. However, two disturbing factors, noise and redundancy in data, lack interpretation for prediction results, impede further development GCN. One solution is to recognize a predictive yet compressed subgraph get rid obtain interpretable part graph. This setting similar information bottleneck (IB) principle, which less studied on graph-structured data Inspired by IB we propose novel (SIB) framework such subgraphs, named IB-subgraph. intractability mutual discrete nature makes objective SIB notoriously hard optimize. To this end, introduce bilevel optimization scheme coupled with estimator irregular graphs. Moreover, continuous relaxation selection connectivity loss stabilization. We theoretically prove error bound our estimation noise-invariant Extensive experiments learning large-scale point cloud tasks demonstrate superior property
منابع مشابه
Information Bottleneck Approach to Predictive Inference
This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication. The relationship to thermodynamic efficiency is discussed. The overall aim of this paper is to explain how this information theoretic approach provi...
متن کاملPICASSO: Exploratory Search of Connected Subgraph Substructures in Graph Databases
Recently, exploratory search has received much attention in information retrieval and database fields. This search paradigm assists users who do not have a clear search intent and are unfamiliar with the underlying data space. Specifically, query formulation evolves iteratively as the user becomes more familiar with the content. Despite its growing importance, exploratory search on graph-struct...
متن کاملPredictive encoding: Recognizing opportunities
Suspended goals are those that are postponed by an agent because they do not fit into the agent's current, ongoing agenda of plans. Recognizing later opportunities to achieve suspended goals is an important cognitive ability because it means that one can defer work on a goal until one is in a better position to achieve the goal. This paper focuses on when and how such opportunities are recogniz...
متن کاملInformation Bottleneck Co-clustering
Co-clustering has emerged as an important approach for mining contingency data matrices. We present a novel approach to co-clustering based on the Information Bottleneck principle, called Information Bottleneck Co-clustering (IBCC), which supports both soft-partition and hardpartition co-clusterings, and leverages an annealing-style strategy to bypass local optima. Existing co-clustering method...
متن کاملConditional Information Bottleneck Clustering
We present an extension of the well-known information bottleneck framework, called conditional information bottleneck, which takes negative relevance information into account by maximizing a conditional mutual information score. This general approach can be utilized in a data mining context to extract relevant information that is at the same time novel relative to known properties or structures...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence
سال: 2021
ISSN: ['1939-3539', '2160-9292', '0162-8828']
DOI: https://doi.org/10.1109/tpami.2021.3112205